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1. Proof of Proposition 8.1 

Proof of Proposition 8.1. First, we recall the notations introduced in [3]. Let N 
be a positive integer. Then, Xjv stands for the family of subsets of {!,..., N} 
of size less than 2. Let T be a set of vectors indexed by In- In the sequel, T is 
assumed to be a compact subset of M(^(^+i)/2)+i. The following lemma states 
a slightly modified version of the upper bound in remark 7 in [3] . 

Lemma 1.1. Let T be a supremum of Rademacher chaos indexed byXiq of the 
form 



T := sup 



N 



where Ui, . . . , Um are independent Rademacher random variables. Then for any 



'{T > E[T] + x} < 4cxp 



(1) 



where D and E are defined by: 



D 



sup sup 

teT a:||Q||2<l 



N 



1=1 j^i 



sup sup 

«erQ,(i),Q(2),j|Q(i)||2<i ||a(2)||<i 



1=1 j^i 



(1)^(2) 
3 



1 
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Contrary to the original result of [:>], the chaos arc not assumed to be ho- 
mogeneous. Besides, the tj^} are redundant with t0. In fact, we introduced this 
family in order to emphasize the connection with Gaussian chaos in the next 
result. 

A suitable application of the central limit theorem enables to obtain a corre- 
sponding bound for Gaussian chaos of order 2. 

Lemma 1.2. Let T he a supremum of Gaussian chaos of order 2. 

(2) 



T := sup 



where Yi, . . . , Yj^ are independent standard Gaussian random variable. Then, 
for any x > 0, 

P{T>E[r]+x}<exp(-^^A^) , (3) 



where 



D := sup sup y ^ Yi{l + Sij)ajt^i_j'^ 

teT aeR"||a||2<l 



E := sup sup sup ai,ta2j^{jj}(l + (^ij) . 

t^T a\, ||Qi||o<la2. ||o2||2^1 i A 

The proof of this Lemma is postponed to the end of this section. To conclude, 
we derive the result of Proposition 8.1 from this last lemma. For any matrix 
Re F,we define the vector t^ £ ]^nrinr+i)/2+i indexed by Inr as follows 

Hi^,k).Xj,i)} '■= - ^i^^>~;^' Hi^m and t^ := -tr{R) , 

where Si_j is the indicator function of i = j. In order to apply Lemma 1.2 with 
N = nr and T — {t^\R £ F}, we have to work out the quantities D and E. 



{r n r n 

,:=l k=l j = l 1=1 



4 



sup sup 2 <^ ^ ^ Y[t,k] ■ 



-RS-FcteM"'-, |la|l2<l 



n 

I 1=1 k=i j=i 



2 1 " ' / ^ ^ 
= sup sup - S E E E 



RGF aeK"'', ||a||2<l ''^ 
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Applying Cauchy-Schwarz identity yields 

4 ( n r / r \2 



«^ _R6F 



k=lj = l \i=l 



= - sup tr{RYY*R*) . (4) 
n ReF 

Let us now turn the constant E 
E = sup sup ^ ^ {^ + S^JSkJ)t^f'al,a',^^ 

'"•^^ ai,Q;2€M"'' l<i,i<r l<fc,i<n 

llai||2 < IJhslU < 1 

= sup sup ~ X! X! ^[*J1"i,»"2j • 

ai,Q!2GlR"'" l<i,i<rl<fe<ri 

liailh < l,|la2||2 < 1 
From this last expression, it follows that i? is a supremum of L2 operator norms 

S=-sup ^„,,^(Diag^"\R) 

where Diag^^^ (R) is the {nr x nr) block diagonal matrix such that each diagonal 
block is made of the matrix R. Since the largest eigenvalue of Diag^'^^R) is 
exactly the largest eigenvalue of R, we get 

2 

-E = - sup </Jmax(i?) ■ (5) 

n ReF 

Applying Proposition 1.2 and gathering identities (4) and (5) yields 

t 



¥{Z > E(Z) +t) < exp 



A- 



where B = and y = i:>2. □ 



Proof of Lemma 1.1. This result is an extension of Corollary 4 in [■')]. We shall 
closely follow the sketch of their proof adapting a few arguments. First, we upper 
bound the moments of (T — E{T))^. Then, we derive the deviation inequality 
from it. Here, :r-|_ = max(x, 0). 

Lemma 1.3. For all real numbers q >2, 

\\{T-E{T))+\\g<^jE{D)+LqE, (6) 

where \\T\\'^ stands for the q-th moment of the random variable T. The quantities 
D and E are defined in Lemma 1.1. 
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By Lemma 1.3, for any i > and any q > 2, 

E [{T-E{T))l 



' (T > E(T) + t) < 



< 



n:^E{D) + LqE 
i 



The right-hand side is at most 2"« if y/LqE{D) < t/A and LqE < t/A. Let us 
set 

- _±_ 
^° 16LE(7:>)2 ^ ALE ' 

If go > 2, then P (T > E(r) + < 2-?". On the other hand if qo < 2, then 
4 X 2-1" > I. It follows that 



'(T > E(r) +t) < 4cxp 



log(2) 
AL 



t 



4E(D)2 £: 



□ 



Proof of Lemma L3. This result is based on the entropy method developed in 
[3]. Let / : ^ E be a measurable funetion such that T = f{Ui, . . . ,Un)- In 
the sequel, J7{, . . . , U'j^ denote independent eopies of [/i, . . . , t/jv- The random 
variable T/ and V'^ are defined by 

Tl := /([/i,..., [/,_i,(7;, [/,+!,..., f/^) , 



V 



+ 



= E 



N 



.1=1 



where refers to the set {Ui, . . . , Un}- Theorem 2 in [:>] states that for any 
real q>2, 



\\{T-E{T))+\\,<^Lq\\VV+\U. (7) 
To conclude, we only have bound the moments of \/V^ . By definition. 



T = sup 



N 



Since the set T is compact, this supremum is achieved almost surely at an 
element t'^ of T. For any 1 < i < A^, 
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Gathering this bound for any i between 1 and N , we get 

N 



V- < 







r 













r N 



< 2 sup 

aeR", ||q||2<1 



1=1 ^ 



N r 



= 2D'' 



< 2 sup sup Uj y ^ ajt^i jj 

teT aeK", ||a||2<l j=i L 

Combining this last bound with (7) yields 

||(T-E(T))+||, < y^V2\\D\\, 

E{D) + \{D-E{D))+\\ 



< y/Lq 



(8) 



Since the random variable D defined in Lemma l.f is a measurable function 
/2 of the variables Ui, . . . ,Un, we apply again Theorem 2 in [3]. 



\\iD-EiD))+\\, < ^Lq 



where is defined by 



V+ := E 



AT 



N 



and D'^ /2(C^i, • ■ • , C^i-i, U^, Ui+i, . . . , Un)- As previously, the supremum in 
D is achieved at some random parameter {t^,a^). We therefore upper bound 



as previously. 



AT 



v.^ < El 



i=l 
N 



N 



1=1 ^ j^i ^ 



< 2 sup E"fE"^%J} 

a(2)GR«,|[a||2<i V 

Gathering this upper bound with (8) yields 

\\{T-E{T))+\\g<^E{D)+LqE . 



□ 
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Proof of Lemma 1.2. We shall apply the central limit theorem in order to trans- 
fer results for Rademacher chaos to Gaussian chaos. Let / be the unique function 
satisfying T = /(yi, . . . , un) for any {yi, . . . , y^) € M^. As the set T is com- 
pact, the function / is known to be continuous. Let (U^'''^)i<i<N,j>o i.i.d. 
family of Rademacher variables. For any integer n > 0, the random variables 
F(") and r(") are defined by 



/ " ttU) " 7-rUJ \ 

rp{n) _ f 



Clearly, T("' is a supremum of Rademacher chaos of order 2 with nN variables 
and a constant term. By the central limit theorem, T^^"^ converges in distribution 
towards T as n tends to infinity. Consequently, deviation inequalities for the 
variables T'"' transfer to T as long as the quantities E , and E[T(")] 

converge. 

We first prove that the sequence converges in expectation towards T. 
As T^"^ converges in distribution, it is sufficient to show that the sequence 
is asymptotically uniformly integrable. The set T is compact, thus there exists 
a positive number too such that 



< u 



N 

i + (^ + i)/2^(r/"))' 



It follows that 



< ti 



N +lY N + 2 



N 



(9) 



The sequence Y^^'^ does not only converge in distribution to a standard nor- 
mal distribution but also in moments (see for instance [1] p. 391). It follows that 

< oo and the sequence / {Y^'"'^^ is asymptotically uniformly in- 
tegrable. As a consequence, 



lim E 



T 



(n) 



= E[T] 



Let us turn to the limit of E [Z)'"'] . As the variable T'"' equals 



sup 

ter 



(fc) 



u, 



(I) 



l<k,l<n 



l<k<r 



l^k 
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it follows that 



sup sup 

teT aeK"«, |lQ!il2<l 



E E f^iiE^ E ^ + ^T.^^] 

l<i<N l<k<n ^ j^i l<l<n l^k ^ 



< 



sup sup <^ ^ ^ E(l + ■ 

ter QeK"«, ||a||2<i I ^ v 



+ (10) 



where the random variable A^") is defined by 

N 



u.. 



U) 



A("):=sup sup VE*{«}^^"» 

teT QeR"«_ ||a||2<i ^.^^ rt 



Straightforwardly, one upper bounds A^"^ by too/n^J^iL 1^2^=1 (^i"*') ^'^I'i 
its expectation satisfies 



E 



< t. 



oo \/ : 

n 



which goes to when n goes to infinity. Thus, we only have to upper bound 
the expectation of the first term in (10). Clearly, the supremum is achieved only 
when for all I < j < N, the sequence (q;^'^)i<;<„ is constant. In such a case, 
the sequence (Q!^"'^')i<j<Ar satisfies ||a'"'^-'||2 < it follows that 



E 



= E'^ sup sup E 

teT aGR"|[Qjj2<l 



In 



Let g be the function defined by 



5(yi,...,?/Ar) =sup sup 

teT QeR"||Q|t2<i 



for any (?/i, . . . , j/at) e M^. The function g(.) is measurable and continuous as 
the supremum is taken over a compact set. As a consequence, g(y^"-') converges 
in distribution towards (/(i^). As previously, the sequence is asymptotically uni- 
formly integrable since its moment of order 2 is uniformly upper bounded. It 
follows that limE ^¥.{D\. 



Third, we compute the limit of By definition. 



N n r n 

sup sup EE"M EE"2j— 

teTai,a2eR"«, It Ql || 2 <1 , lla2 || 2 <i ^ ^ n 



2E- 



i=l k=l 

N N 



l^k 



sup sup y^y^(i + (5,,, 

teTai,a2, Ilailt2<l,ll«2ll2<l~^ ^ 



t 



EE"i' 

.k=l 1=1 



o 



1' 

n 
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As for the computation of Z?'"', the suprcmum is achieved when the sequences 
{a.\ i)i<k<n and (q!2 j)i<i<n are constant for any i E {1, . . . , N}. Thus, we only 
have to consider the supremum over the vectors ai and a2 in M.^ . 

N N 

i;^"^ = sup sup ^""(1 + S,j)Ujai.ia2,j + O 

It follows that converges towards E when n tends to infinity. 

The random variable T^"' -E(r(")) converges in distribution towards T — E(r). 
By Lemma 1.1 , 

P(T - E(T) > x) < lim exp (- ^, f',,, — A —f^. — ^ , 

for any a; > 0. Combining this upper bound with the convergence of the se- 
quences D^"^ and i?'"-* allows to conclude. □ 




2. Proof of Theorem 3.1 



Proof of Lemma 8.3. We only consider here the anisotropic case, since the isotropic 
case is analogous. This result is based on the deviation inequality for suprema of 
Gaussian chaos of order 2 stated in Proposition 8.1. For any model to' belonging 
to AI, we shall upper bound the quantities E(Zm/), Sm', and E(W,„/) defined 
in (42) in [G]. 



1. Let us first consider the expectation of Z„ 
space defined by 



Let [/,; „, 



be the new vector 



UL 



■.= u„ 



p 



where Um,m' is introduced in the proof of Lemma 8.2 in [(i]. This new space 
allows to handle the computation with the canonical inner product in the 
space of matrices. Let B^Ji „/2 be the unit ball of C/,^ with respect 
to the canonical inner product. If R belongs to Um,m' , then j|i?||-H' = 
\\RVDj:/p\\f, where stands for the Frobenius norm. 



1 



sup —tr [RD^{YY* - Ip 



sup tr 
flee' 



,(2) 

„2 




(11) 
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where liu' ^ refers to the orthogonal projection with respect to the 
canonical inner product onto the space U^^,. Let Fi,...,Fci 2 ,2 de- 



note an orthonormal basis of ^, . 



m2 ™'2 



tr' F, 




1=1 = ! 

7772 777 '2 



< 



E —tr{F,D^F,) 

E 



Applying Cauchy-Schwarz inequality, it follows that 

E(Z„0 < 



' 2d„i2 ,„/2(^„iax(S) 



2. Using the identity (11), the quantity Bm' equals 



B,n' = - sup (^max R 



p 



(12) 



As the operator norm is under-multiplicative and as it dominates the 
Frobenius norm, we get the following bound 



Bm' < 



Vmax(S) 



np 



(13) 



3. Let us turn to bounding the quantity E{Wm')- Again, by introducing the 

j(2) 

,7n'' 



ball BIJ2 we get 
4 



1 



sup — tr [i?YY*L>Ei?] 



< 1:^:11^ sup irteYY^i?] 



< 



4V5max(S) 



1+ sup tr [R {YY* - Ip2) R] 
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Let Fi, . . . Fd^2 „/2 Ein orthonormal basis of U'^ and let A be a vector 
in _ ^j-i^j, f-Qj. ^2 norm. 

e( sup tr[R(YY^ ~ Ip2) R]^] 

= e( sup ^ A.Ajtr [^;Fj(YY^/n-/p2)] 



A||2<1 



The second inequality is a consequence of Cauchy-Schwarz inequality in 
]g('^m2.m'2) sincg |;];jg ^2 nomi of the vector (AiAj)i<ij<d 2 /2 G E'^™^ '"'^ 
is bounded by 1. Since the matrices Fi are diagonal, we get 



E( sup tr[R{YY*/n- I)Rf\ < - ^ \\F,Fj\\l 



ReB 



(2) 

2^/2 



It remains to bound the norm of the products FiFj for any i,j between 1 



and dm2_„/2. 

d-rr,2 m'2 



n2 /rf„ 



ij — l i,j — ^ k—1 



For any k € {!,..., p^}, J2^=l^"''^ < 1 since (i^i, . . . , ^d^2,„.,2 ^ 

form an orthonormal family. Hence, we get 



All in all, we have proved that 

4(pmax(S) 



1 



2d„ 



(14) 



Gathering these three bounds and applying Proposition 8.1 allows to obtain the 
following deviation inequality: 



< exp ■ 

< exp ■ 



[(^l+a/2-l)^d„,2.„.,2+c]" ^ ^A^[(^/l+a/2-l)Vrf„2,^/2+;] 



2Li(l+^2(i,,^2 „/2 /n) 

A 



2Li(l+^2(i^2^,„/2/n) 72-^2 



y2i2 



Li[l + ^2d^2_„/2/nJ V2i 



A 
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where u>m.m' = ^ ^1 + a/2 — ■^(i,„2 ,„/2 . As n and rf^^^m'^ are larger than 
one, there exists a universal constant Ll, such that 



(v/l + a/2-l)2<2,,„,2 . Vn(VTT^- 1)V^ 

2Li (1 + ^2dm--,ra'^ln) 



V2L2 

(v/l + a/2-l)'A (v/l + Q'/2-l) 



Since the vector space Um,m' contains all the matrices D{9') with 9' belonging to 
m' , djn^ m'2 is larger than dm' ■ Besides, by concavity of the square root function. 



it holds that ^/l + a/2- 1 > a[A^/l + a/2]-'^ . Setting L[ := [4Li(l + V2)]^^ A 
[\/2i2]^^ and arguing as previously leads to 



g(Vl + a/2- l)y/d„,2^m,2 . ^ ^ 

Li(l + V2d„2',„,2/n) '^V2L2- 



A Vn 



Gathering these two inequalities allows us to conclude that 



< exp < —Ll'iy d. 



a a 

A 



VI + q/2 1 + a/2 



\/l + a/2 



A Vn 



□ 



Proof of Lemma 8.4 in [<']■ The approach falls in two parts. First, wc relate the 
dimensions dm and d^^ to the number of nodes of the torus A that are closer 
than rm or 2rm to the origin (0, 0). We recall that the quantity is introduced 
in Definition 2.1 of [G]. Second, we compute a nonasymptotic upper bound of 
the number of points in that lie in the disc of radius r. This second step is 
quite tedious and will only give the main arguments. 

Let m be a model of the collection A^i. By definition, m is the set of points 
lying in the disc of radius r„i centered on (0, 0). Hence, 

where the matrices 4'^^- are defined by Eq. (14) in [r,]. As ^'^.j — the 
dimension dm of 0,„ is exactly the number of orbits of m under the action of 
the central symmetry s. 

As dm^ is defined as the dimension of the space Um, it also corresponds to 
the dimension of the space 



vect {C{9), 9 e e,„} + vect {C{9f,9 e 9™} 



(15) 
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Figure 1 . The black dots represent the orbit space of m and the white dots represent the 
remaining points of the orbit space of J\f{m) . 

which is clearly in one to one correspondence with . Straightforward compu- 
tations lead to the following identity: 

ji)C'(^'i2 J2) = C'(*n+i2ji+j2) [1 + 'Sii+i2,ii+j2] 

where Sx,y is the indicator function of x = —x and y = —y in the torus A. 
Combining this property with the definition of 0m, we embed the space (15) in 
the space 

ueci{C(^'ii+i2ji+j2) , (ii, ji), (i2, j2) e mU {(0,0)}} , 

and this last space is in one to one correspondence with 

?;ect{*,i+j2ji+j2, (ii,ji),(i2,j2) e mU{(0,0)}} . (16) 

In the sequel, N{m) stands for the set 

{(«! +«2,ii +j2), (ii,ii),(i2,i2) e mU{(0,0)}} . 

Thus, the dimension is smaller or equal to the number of orbits of Af{m) 
under the action of the symmetry s. 

To conclude, we have to compare the number of orbits in m and the number 
of orbits in Af{m). We distinguish two cases depending whether 2rm + 1 < p 
or 2rjn + I > p. First, we assume that 2rm + 1 < P- For such values the disc 
of radius centered on the points (0, 0) in not overlapping itself on the torus 
except on a set of null Lebesgue measure. In the sequel, [a;J refers to the largest 
integer smaller than x. We represent the orbit space of m as in Figure 1. To any 
of these points, we associate a square of size 1. If we add 2 + 2[r„i\ squares to 
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the dm first squares, we remark that the half disc centered on (0, 0) and with 
length Tm is contained in the reunion of these squares. Then, we get 



(17) 



The points in M{m) are closer than 2r,„ from the origin. Consequently, all the 
squares associated to representants of M{m) are included in the disc of radius 
2r™ + V2. 



+ 2 + 



Combining these two inequalities, we are able to upper bound d„2 
2 + 2L2r„J +d,„2 < 4|l + ^l (d™ + l + 2Lr™J) , 



V2 



a/2 



2r, 



2r, 



Applying again inequality (17), we upper bound 

1 



2 

rm< - 

TT 



1 + -{l + d„ 



Gathering these two last bounds yields 

2 



< 4n 



V2 

2 7^ 771 



1 



1 



4 

1 + - 



This upper bound is equivalent to 4c?„j, when dm goes to infinity. Computing 
the ratio d^.'^ /dm for every model m of small dimension allows to conclude. 

Let us turn to the case 2rm + 1 > _p. Suppose that p is larger or equal to 
9. The lower bound (17) does not necessarily hold anymore. Indeed, the disc 
is overlapping with itself because of toroidal effects. Nevertheless, we obtain a 
similar lower bound by replacing rm by {p — l)/2: 

^™4-2 + 2L^J>^fcll!. 

The number of orbits of A under the action of the symmetry s is {p^ + l)/2 
if p is odd and [(p+ 1)^ — l]/2 if P is even. It follows that (i,„2 < [{p+lf - l]/2. 
Gathering these two bounds, we get 



< 



(p+1)' 



7r(p- 1)2/4 -2(p+l) ■ 

This last quantity is smaller than 4 for any p > 9. An exhaustive computation 
of the ratios when p < 9 allows to conclude. 
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Figure 2. The black dots represent the orbit space of m under the action of G and the white 
dots represent the remaining points of the orbit space ofAf^''°{m). 



Let US turn to the isotropic case. Arguing as previously, we observe that the 
dimension is the number of orbits of the set m under the action of the group 
G introduced in in [G] Sect. 1.1 whereas is smaller or equal to the number of 
orbits of A^'**°(m) under the action of G. As for anisotropic models, we choose 
represent these orbits on the torus and associate squares of size 1 (see Figure 
2). Assuming that Vm < {p — l)/2, we bound dm and d,„2. 



As a consequence, d„2 is smaller than Ad„i when (i,„ goes to infinity. As previ- 
ously, computing the ratio /dm for models m of small dimension allows to 
conclude. The case r„j > (p — l)/2 is handled as for the anisotropic case. □ 

3. Proofs of the minimax bounds 

Proof of Lemma 8.5 in [O]. This lower bound is based on an application of Fano's 
approach. See [7] for a review of this method and comparisons with Le Cam's and 



dm + l > 





Gathering these two inequalities, we get 




Verzelen/ Technical appendix 



15 



Assouad's Lemma. The proof follows three main steps: First, we upper bound 
the KuUback-Leibler entropy between distributions eorresponding to 6i and 62 
in the hypereube. Second, we find a set of points in the hypercube well separated 
with respect to the Hamming distance. Finally, we conclude by applying Birge's 
version of Fano's lemma. 

Lemma 3.1. The Kullback-Leihler entropy between two mean zero-Gaussian 
vectors of size with precision matrices {lp2 — C(0i)) j and {lp2 — C(02)) /c^ 
equals 



/C(0i,02) = 1/2 



log 



' ) + tr ( [V - C{e2)] [V - C{6,)] - p- 



IV-C(02)|, 

where for any square matrix A, \A\ refers to the determinant of A. 

This statement is classical and its proof is omitted. The matrices (7^2 — C(6'i)) 
and (/p2 — C(02)) are diagonalizable in the same basis since they are symmetric 
block circulant (Lemma A.l in [(i]). Transforming vectors of size p^ into p x p 
matrices, we respectively define Ai and A2 as the p x p matrices of eigenvalues 
of (/p2 - C{9i)) and (7^2 - 0(62)). It follows that 

m,^2)^i/2 E f^-iog^'^'- 



l<z,j<p 

For any a; > 0, the following inequality holds 

9 / 1 



X - 1 - log(x) < ^„ ^ 

It is easy to establish by studying the derivative of corresponding functions. As 
a consequence, 

A2[i.j] , /A2[i,j]\ 9 /A2 Ai[i,i] 

- log -— - - 1 < — ' 



Ai[i.j] \Xl[^J]J 64 \Xi[i,j] A: 



^2li,J\ 



^ ^ (yT-. + ^^il^'^l - (-18) 

64 vAi[ij] X2b,i]J 

Let us first consider the anisotropic case. Let m be a model in A^i and let 
9' belong 0,„ n Si (Op, 1). We also consider a positive radius r such that (1 — 
||0'||i — 2rd,n) is positive. For any 6*1, 62 in Cm{9' , r) the matrices (/p2 — C{9i)) 
and (/p2 — C(^2)) are diagonally dominant and their eigenvalues Ai[j,i] and A2[i,i] 
are larger than 1 — |j0'||i — 2rdm. 

1<2,J <p 

2 



9 


16(1 


-\\9'\\i-2rd,nY 




9 


16(1 


-\\9%~2rd^Y 




9d„,r'p^ 



< ..n 7^IT^\\Ci0l)^Ci92)\ 



- 8(l-||^'|li-2rd„)2 ■ ^ ' 
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We recall that refers to the Frobenius norm in the space of matrices. 

Let us state Birge's version of Fano's lemma [1] and a combinatorial argument 
known under the name of Varshamov-Gilbert's lemma. These two lemma are 
taken from [4] and respectively correspond to Corollary 2.18 and Lemma 4.7. 



Lemma 3.2. (Birge's lemma) Let (5, d) be some pseudo-metric space 
{Ps,s S S} he some statistical model. Let k denote some absolute constant 
smaller than one. Then for any estimator 's and any finite subset T of S , set- 
ting S = mins_t<£T,s^td{s,t), provided that maxs.tg^ ^^(Ps, Pt) < '^loglTj, the 
following lower bound holds for every p > 1, 

supE,[dP(s,s)] > 2-PSP{l - k) . 

sGS 

Lemma 3.3. (Varshamov-Gilbert's lemma) Let {0, 1}'' be equipped with 
Hamming distance dn . There exists some subset <I> of {0, 1}'' with the following 
properties 

dH{4>, 0') > rf/4 for every (0, 4>') £ $^ with 7^ 0' and log |<f>| > ^ . 

8 

Applying Lemma 3.2 with Hamming distance dn and the set $ introduced 
in Lemma 3.3 yields 



sup Eg 

6»GC„(e',r) 



e,9 



> 



provided that 



< 



S{\-\\6'\\i-2rd,_ 
Let us express (20) in terms of the Frobenius norm 

dmr^p^ 



sup Eg 
6leC„(6(',r) 



\c{e)-c{e)\ 



> 



(20) 



(21) 



Since for every 6 in the hypercubc, <t ^(/p2 — C{0)) is diagonally dominant, 
its largest eigenvalue is smaller than 2<t^^. The loss function l{6,d) equals 
a^/pHr{[C{e) - C{0)]il - C{e))-'^[C(9) - C{9)]}. It follows that 



sup Eg 

6»GC„(e',r) 



I [0,9 



> a' 



(22) 



Condition (21) is equivalent to r^(l — II II 1 — 2r(im) ^ < K/(9p^n). If we assume 
that 



'^(i-ii^^'iiir 



18p^n 



(23) 
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then l-\\e'\\i-2rdm > (1 - ||^'|| i) (^1 - 2d™^K/(18rip2) j . This last quantity is 

larger than (1 — ||0'||i) /\/2 if dm is smaller than 1.5(a/2 — \)\Jnjp- j k. Gathering 
inequality (22) and condition (23), we get the lower bound 



inf sup Eg 

? eGCo[C™(e',r)] 



> inf 



sup 



9ec„ 



9',-A(i-||e'|U)y=^ 



(m) 



drn.a 



One handles models of dimension dm between 1.5(-\/2 — V)^n'p^ j k and by 
changing the constant L in the last lower bound. 



Let us turn to sets of isotropic GMRFs. The proof is similar to the non- 
isotropic case, except for a few arguments. Let m belongs to the collection M.\ 
and let B' be an element of ej^° n Si (Op, 1). Let r be such that 1 - - M]^ 



is positive. If Q\ and belong to the hypercube 



then 



/C(01,02) < 



9dmr2p2 



2(l-||0'||i-8r4-)2 
Applying Lemma 3.2 and 3.3, it follows that 

d'"° 



inf sup Eg 

? eecjj°(e',r) 



> ZI!2_(1_k) 



provided that \.hdm'r^V^"^^ - ll^'lli - 87"^™°) ^ < '«dJ^°/8. As a consequence, 



inf sup Eg 



> 



if (l - ||6''||i - 8rdJ^°) < ^(36^^71) ^ We conclude by arguing as in the 
isotropic case. □ 



Proof of lemma 8. 6 in [(>]. Let m be a model in i , r be a positive number 
smaller than l/(4c?m), and 6 be an element of the convex hull of Cm(Op,r). 
The covariance matrix of the vector is S = a"^ [I — C{9)]~^ . Since the 
field X is stationary, Var0(Ar[o,o]) equals any diagonal element of S. In partic- 
ular, Ya,Te{X[a,o]) corresponds to the mean of the eigenvalues of E. The matrix 
(/ — C{9)) is block circulant. As in the proof of Lemma 20, we note A the px p 
matrix of the eigenvalues of {Ip2 — C{9)). By Lemma A.l in [G], 



A[i,j] = 1 + ^ 9[kj] cos 



27r 



ik 
P 
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for any 1 < i,j < p. Since 6 belongs to the convex hull of Cm{Op, r), d[kj] is zero 
if {k,l) ^ m and \d[kj]\ < r if {k,l) E m. Thus X](fc i)eA [^['""■'ll smaller than 
1/2. Applying Taylor-Lagrange inequality, we get 



1 



< 1 



1 + X-' " (1 - \x\f 
for any x between —1 and 1. It follows that 



k,leA 



'[fe,;l COS 



" /ik 




27r — H 


--)] 




Pj. 



-8 



'[fcj] COS 



" fik 




27r — - 






Pj. 



Summing this inequality for all (z, j) S {1, . . . ,p} , the first order term turns out 
to be tr[C{6)]/p^ which is zero whereas the second term equals 8tr[C (9)'^] / . 
Since there are less than 2dm non-zero terms on each line of the matrix C{6), 
its Frobenius norm is smaller than 2dmP^r^- Consequently, we obtain 

Vare (X[o,o]) < cr^ (l + IGd^r^) . 



□ 



Proof of Lemma 8.7 in [o]. This property seems straightforward but the proof 
is a bit tedious. Let i be a positive integer smaller than Card(A^i). By definition 
of the radius rm in Equation (10) in [0], the model m^+i is the set of nodes in 
A\{(0, 0)} at a distance smaller or equal to /'mi+i from (0, 0), whereas the model 
TTii only contains the points in A \ {(0,0)} at a distance strictly smaller than 
^mi+i from the origin. 

Let us first assume that 2rmi+i < P- In such a case, the disc centered on 
(0,0) with radius r^^^^ does not overlap with itself on the torus A. To any 
node in the neighborhood m^+i and to the node (0, 0), we associate the square 
of size 1 centered on it. All these squares do not overlap and are included in 
the disc of radius rjm+i + V2/2. Hence, we get the upper bound 2d„i-_^_i + 1 < 
"'(''mi+i + ■\/2/2)^. Similarly, the disc of radius r^.^j — V2/2 is included in the 
union of the squares associated to the nodes rrii U {0, 0}. It follows that 2drni + 1 
is larger or equal to tt (jmi^i — \/2/2) . Gathering these two inequalities, we 
obtain 

rfm.+i ^ {rm,+, + \/2/2)^ - 1 

" {rn^,^^ " ^2/2)' - 1 ' 

if '"mi+i is larger than 1 + \/2/2. If r,„.^j larger than 5, this upper bound is 
smaller than two. An exhaustive computation for models of small dimension 
allows to conclude. 
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If 2rmi+i > P and 2r„j. < p, then the precedmg lower bound of and the 
preceding upper bound of d„i.^^ still hold. Finally, let us assume that 2rmi > P- 
Arguing as previously, we conclude that 2d,n, + 1 > tt{p/2- . The largest 
dimension of a model m G A4i is (p^ — l)/2 if p is odd and ((p + 1)^ — 3)/2 if p 
is even. Thus, dmi+i < [(p + l)'^ — 3]/2. Gathering these two bounds yields 

drn^+. ^ ^ (p+ 1)^-3 

~ (p-V2)^ 

which is smaller than 2 if p is larger than 10. Exhaustive computations for small 
p allow to conclude. 

□ 



Proof of Proposition 6. 7 in [(>]. This result derives from the upper bound of the 
risk of 9p-^ stated in Theorem 3.1 and the minimax lower bound stated in Propo- 
sition 6.6 in [G]. 

Let £{a) be a pseudo-ellipsoid that satisfies Assumption (Hq) and such that 
ct? > For any 9 in £{a) n Bi{Op, 1) nU{p2), the penalty term satisfies 

pen(TO) — Ka^ p\p2dm/np^ is larger than Kdm^-max{^) /np^ . Applying Theo- 
rem3.1, we upper bound the risk 9p-^ 



l{ep,,9)\<L^{K) inf [Z(0,„,,,,0)+pcn(m)]+L2(X)p2 



np^ 



for any 9 G £{a) n Bi{Op,l) nU{p2). It follows that 



sup Eg 
9G£(o)nBi(0p4)nW(p2) 



l[9p„9)] <L{K) 



inf 



2 2 ^ni 
PlP-lO- 2 

np'^ 



Let « be a positive integer smaller or equal than Card(Ali). We know from 
Section 4.1 in [G] that the bias l{9mi,d) of the model nii equals Var(Ar[o,o]|X„i.) — 
(T^. Since 9 belongs to the set £{a) nSi(Op, 1), the bias term is smaller or equal 
to af_^_l with the convention CLcaid(Mi)+i ~ Hence , the previous upper bound 
becomes 



E« 



< UK) inf 

l<i<Card(A1i) 



2,2 2 '^m.i 

np'^ 



< L{K,pi,p2) inf 

l<i<Card(A^i) 



cr 



np^ 



(24) 



Applying Proposition 6.6 in [fi] to the set £{a) n Si (Op, 1) fMA{2), we get 



inf sup I 



> inf sup Eg 

? ee£(a)nei(0p,i)nw(2) 



> L sup 

l<i<Card(A1i) 



2 . 2 ^nij 

a.: A cr — ; 
np'^ 
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Let us define i* by 



sup <^ 1 < i < Card(A^i) , > 



with the convention sup0 = 0. Since al > a^/np^, i* is larger or equal to one. 
It follows that 



inf sup Eg 



I [0,9 



\ r I 2 , ^ dm , 

> L2 a,.+i V ^ 



Meanwhile, the upper bound (24) on the risk of 9p^ becomes 



'pi I ' 



np^ 



which allows to conclude. 



□ 



4. Proof of the asymptotic risks bounds 

Proof of Corollary 4-6 in [d]. For the sake of simplicity, we assume that for any 
node (i,j) € to, the nodes (i,j) and (— .7) are different in A. If this is not 
the case, wc only have to slightly modify the proof in order to take account that 
may equal one. The matrix V is the covariancc of the vector of size dm 

Since the matrix E of is positive, V is also positive. Moreover, its largest 
eigenvalue is larger than 2(pi„ax(S). 

Let us assume first the 9 belongs to 9^ and that Assumption (Hi) is fulfilled. 
By the first result of Proposition 4.4 in [G], 



lim np 

n — *+oo 



(S) (^inax(S) 

which corresponds to the first lower bound (30) in [(>]. 

Let us turn to the second result. Wc now assume that 9 satisfies Assumption 
(IHI2). By the identity (28) of Proposition 4.4 in [G], we only have to lower bound 
the quantity tr [VW''^] . 

tr [V-^W] > ip,r..AVyHr [W] > ^——tr[W] . 

2v3niax(E) 

Since the matrix ~ [/p2 — C{9)\ is diagonally dominant, its smallest 
eigenvalue is larger than 0-^^(1 — j|0||i). The matrix (/p2 — C{9m.pi))^ {Ip2 — C{9)^ 
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is symmetric positive. It follows that W is also symmetric positive definite. 
Hence, we get 

tr [V'^W] (26) 



> 



^ [1- llfi'lli]}^ 



fe=i 



The largest eigenvalue of (/p2 — C(^)) is smaller than 2 and the smallest eigen- 
value of (/p2 — C{9m,pi)) is larger than 1 — ||6',„,pj ||i. By Lemma A.l in [6], these 
two matrices are jointly diagonalizable and the smallest eigenvalue of 

is therefore larger than (1 — \\0„i^p^ l|i)^/4- Gathering this lower bound with (26) 
yields 



tr [v~'w]>''-^[i-\\eu[i 



'rn.pi II Ij 



l2 



Lemma 4. 1 in [G] states that 1 1 6,n,p^ 1 1 1 < 1 1 6* 1 1 1 . Combining these two lower bounds 
enables to conclude. 

□ 



Proof of Example 4. 8 in ffi]. 

Lemma 4.1. For any 9 is the space 6^1^°; the asymptotic variance term of 



qiso 

mi,Pi 



equals 



lim np 

n — ^+oo 



mi ,pi 5 



2a^ 



tr (H^) 



tr (i?2s) 

If 9 belongs to 8^"'"^° and also satisfies (IEII2), then 



lim np 

n — *+oo 



7 ( also fliso 
\^mi,pi ' '^mi.pi 



tr 



tr{H^j:) 



, (27) 



where the p^ x p^ matrix H is defined as H .= C (^'f g) ■ 

Proof of Lemma 4-1- Apply Proposition 4.4 in [d] noting that V = tr[H'EH]/p'^ 
and 



tr 



W 



{I - 9^,..[ifl]H)H^ 



a^p'^ 



To prove the second result, we observe that 0+'^'**° equals • It is stated for 

instance in Table 2 in [G]. □ 



Verzelen/ Technical appendix 



22 



Since the matrix belongs to Qtn^^°i ^'PPly the second result of 

Lemma 4.1. Straightforward computations lead to tr{H^) = \\C ('I'l'^o) IIf — 
and 

tr{H'^T,) = [Var(X[o,o]) + 2cove(X[o,n], X[ia]) + covg (X[o,o], X[2fi])] . 
Since the field X is an isotropic GMRF with four nearest neighbors, 

Xlo.o] = 9[ifl] {X[i,o] + X[~i,o] + X[o,i] + X[o,^i]) + e[o.o] , 

where e[o,o] is independent from every variable X[i,j] with ^ 0. Multiplying 
this identity by X[i,o] and taking the expectation yields 

cove (X[o,o],X[i,o]) = 6'[i,o] [Var (X[o,o]) + 2cove(X[o,o], + covg (X[o,o], X[2,o])] 

Hence, we obtain tr (iJ^S) = 4cove(X[o,o], X[i,o])/0[i,o] and 

tr(ij2) _ 9[i,o] 
tr{mT.) ~ cove(X[o,o],X[i,o]) ' 

which concludes the first part of the proof. 

This second part is based on the spectral representation of the field X and 
follows arguments which come back to Moran [5] . We shall compute the limit of 
covg (X[o,o], X[ifi\) when the size of A goes to infinity. As the field X is stationary 
on A, we may diagonalize its covariance matrix E applying Lemma A.l in [6]. 
We note D^, the corresponding diagonal matrix defined by 



£^s[(i-i)p+i,(i-i)p+j] = X! X! ^'^^'^ (-'^[0,0], X[kj]) cos 



k=l 1=1 



27r 



ki Ij 
— + — 
P P 



for any 1 < i, j < p. Straightforwardly, we express covg (A"[o,o], ATfi.o]) as a linear 
combination of the eigenvalues 



covg {X[o.n], X[i,a]) 



1 



p p 



i=i j=i 



^^cos ( 27r- J Ds[{t~i)p+j,{t-i)p+j] 



Applying Lemma A.l in [(>] to the matrix E and noting that 6 e 0'^°'+ allows 
to get another expression of the eigenvalues of E 

£'S[(*-1)P + J:(*-1)P + J] 



1 - 26i[i,o] 



We then combine these expression. By symmetry between i and j we get 



cov, (X[o.o],X[i.o]) = ^^^. 



cos (27r^ 


) + cos (27r£ 




1 - 29[m 


cos 1 




+ cos 
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If we let p go to infinity, this sum converges to the foUowing integral 



hm covg (X[o,o], X[i,o]) 

p — >+oo 



26'[i,o] 



cos(27ra;) + cos(27ry) 
26[i.o] (cos(27rx-) + cos(27rj/)) 

2ir <.27r 



dxdy 



-1 



1 

4^ 







1 







1 — 26'[i,o] [cos(a;) + cos(y)] 



dxdy 



This last elliptic integral is asymptotically equivalent to logl6[4(l — 4(?[i,o])]^^ 
when 9[ifl\ 1/4 as observed for instance by Moran [5]. We conclude by sub- 
stituting this limit in expression (33) in [(>]. □ 



Proof of Example 4-9 in f(>J. First, we compute [i,o]. By Lemma 4.1 in 

[6], it minimizes the function 7(.) defined in (19) in [6] over the whole space 
0„,i3o. We therefore obtain 



tr [^H] 
tr 



Once again, we apply Lemma A.l in [(>] to simultaneously diagonalize the ma- 
trices H and E"^. As previously, we note the corresponding diagonal matrix 
of S. 



DY,[{i-l)p+j,{i-l)p+j\ 



1 - 2a 



<2-(i + §))+cos(2.(-H + m)) 



1 — 4q; cos (tt^) cos (7r|j 



Analogously, we compute the diagonal matrix D (4'f.o) 

D (*ro) = 2 [cos (2^^) + cos (27ri) 

Combining these two last expressions, we obtain 

(27ri)+cos(2^l) 



p p 



i=i 3=1 



4a cos (ttI) cos (tt 



Let us split this sum in 16 parts depending on the congruence of i and j modulo 
4. As each if of these 16 sums is shown to be zero, we conclude that tr{HYj) = 

-iso.pi 

]m°i [i-O] ^ 0. By Lemma 4.1, the asymptotic risk of 9'^p\-^^ therefore equals 



lim np ]Eg(p) 

n — *H-oo 



/ -ISO, pi . 
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First, we lower bound the numerator 



i=i j=i {1 — 4q;cos (ttI) cos (ttI)} 

As each term of this sum is non-negative, we may only consider the coefficients 
i and j which are congruent to modulo 4. 



p/4-lp/4-l IQ 
i=0 i=0 



(2.^)+ cos (2.^) 



(1 -4a)2 



If we let go p to infinity, we get the lower bound 



lim 



> 



■ / / [cos(27rx) + cos(27r2/)]^ dxdy 
Jq Jo 



p— >+oo (1 — 4a)^ 

Similarly, we upper bound tr{H'^T,) and let p go to infinity 



lim ^ , ^ < 



"'0 



p^+x> p^ 1 — 4q; 

Combining these two bounds allows to conclude 

-iso,pi 



cos(27ra;) + cos(27rj/)]^ dxdy 



hin hm , [0(p)]j^o > 



4q; 



□ 



5. Miscellaneous 

Proof of Lemma 1.1 in [(>]. Let he a, p x p matrix that satisfies condition (3) 
in [()]. For any f < *2 < we define the p x p submatrix C'i-^^i^ as 

C*!!, 42^1^2] C{9)[(ii-l)p+ji,{i2-l}p+j2] , 

for any 1 < ji,j2 < P- For the sake of simplicity, the subscripts (11,12) are 
taken modulo p. By definition of C{6), it holds that Ci-^^i^ = Co,i2-ii for any 
1 < ^1,^2 < P- Besides, the matrices Co,i are circulant for any 1 < i < p. In 
short, the matrix C{9) is of the form 

Co.i Co, 2 ■ ■ ■ Co,p 
C{9)^ : : : : 

\ Co^p Co,i • • • Co,p-i 

where the matrices Co,i are circulant. Let (ii, 12, ji, ^2) be in {!,..., p}^. By 
definition, 

C(6')[(ii-l)p+ji,(i2-l)P+j2] = 6'[i2-il j2-il] • 
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Since the matrix 6 satisfies condition (3) in [()], 0[i2-ii j2-ii] = 0[ii-i2-ji-h\- As 
a consequence, 

C{d)[{ii-i)p+ji,{i2-i)p+h] = C [6)[(i2~i)p+]2,{ii-i)p+]i\ and C{d) is symmetric. 

Conversely, let _B be a x symmetric block circulant matrix. Let us define 
the matrix 9 of size p by 

e[i,]] B[i,{i-i)p+]] , 

for any I < i,j < P- Since the matrix B is block circulant, it follows that 
C{9) = B. By definition, ^[ij] = C{9)li,{i-i)p+j] and 6'[-i,-j] = C{9)[{t-i)p+j,i] 
for any integers 1 < i,i < P- Since the matrix B is symmetric, we conclude that 

e[ij] = 9[-t,-j]. □ 



Proof of Lemma 2.2 in [(>]. For any 9' E 8"^, 'fn.piS') is defined as 

Applying Lemma A.l in [ii], there exists an orthogonal matrix P that simulta- 
neously diagonalizes S and any matrix C{9'). Let us define Y* \/E and 
Dy, '■= P'SP* . Gathering these new notations yields 

7rup(e') = ^tr [{1,2 - D{9')) D^YY^ {lp2 - D{9'))] , 

where the vectors Y* are independent standard Gaussian random vectors. Ex- 
cept YY* , every matrix involved in this last expression is diagonal. Besides, the 
diagonal matrix Z?s is positive since S is non-singular. Thus, 

tr - D{9'))Dj:YW{Ij,2 - D{9'))] 

is almost surely a positive quadratic form on the vector space generated by Ip2 
and D(0+). Since the function D{.) is injective and linear on 9+, it follows that 
7n,p(-) is almost surely strictly convex on . □ 



Proof of Lemma 4-1 and Corollary ^.2 in [()]. The proof only uses the station- 
arity of the field X on A and the l\ norm of 9. However, the computations are a 
bit cumbersome. Let 9 be an element of By standard Gaussian properties, 
the expectation of X[o,o] given the remaining covariates is 



(ij)eA\(o,o) 
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By assumption (H2); the li norm of 9 is smaller than one. Wc shall prove by 
backward induction that for any subset A of A\{(0, 0)} the matrix 9^ uniquely 
defined by 

Eg {X[q.o]\Xa) = and 9^[t,j] = for any ^ A 

satisfies ||6'^|li < \\9\\i. The property is clearly true if ^ = A\{(0, 0)}. Suppose 
we have proved it for any set of cardinality q larger than one. Let A be a subset 
of A\{(0, 0)} of cardinality g - 1 and be an element of A\(AU{(0, 0)}). Let 
us derive the expectation of X[o,o] conditionally to Xj^ from the expectation of 
X[o,a] conditionally to A'^y{(j j-jj. 

Ee{Xio,o]\XA) = Ee[E{Xlofi]\XA)\XAu{i^M] 

= J2 e'^'^^^'^^'>hkd]X[k,i] + 6i^^«*'^'»[i.j]Ee [X[ij]\XAl28) 

Let us take the conditional expectation of X[i,j] with respect to Xau{{o,o)}- 
Since the field X is stationary on A and by the induction hypothesis, the unique 
matrix defined by 

Ee {X[^,,]\XAu{^m}) ^ E 0f^^)^'''"^\k,i]X[Ki] 

{k,l)eAU{{0,0)} 

and = for any (fc,0 ^ AU {(0,0)} satisfies \\9^^]''°''^^ h < Ph- 

Taking the expectation conditionally to Xa of this previous expression leads to 

Ee{Xl^,J]\XA)^ J2 + ■ (29) 

{k,l)GA 

Gathering identities (28) and (29) yields 

EeiX[o,o]\XA)^ E — — aUToW^ , 

since |6'^^^''"'^[»j]6'^u{o o}[°'°l| ^ ^- Then, we upper bound the h norm of 9"^ 
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using that ||6'-^u{(, j)} y ^ .^^^ jjg,^u{(o,o)}|j^ smaller or equal to ||6l||i. 
Il^^lli 



< 











1 - 







11^111+ 




(S(fc,i)6^U{(0,0)} 




- 1 - 




) 


1 - 







ll^lll(l + 




)- 








.Au{(o,o)} 

«i .,■ [0,0] 


) 


1 - 




[0,0] 





|6»Au{(»,j)}[,.^^.j 


(ll^lli-l) 




aAu{(0,0)}, , 

e^,^;]' "[0,0] 


) 


1 - 




)Au{(0,0)}, , 





Since \\9\\i is smaller than one, it follows that < 

Let m be a model in the collection Aii. Since m stands for a set of neigh- 
bors of (0,0), we may define 6*™ as above. It follows that ||6'™||i < |i6'||i. Since 
the field X is stationary on the torus, X follows the same distribution as the 
field X*' defined by X^[i,j\ = X[-i-j\. By uniqueness of 6*™, we obtain that 
^'"[«,i] = ^™[-i--j]- Thus, 0™ belongs to the space 8„i. Moreover, 0™ minimizes 
the function 7(.) on 8m- Since the li norm of 0™ is smaller than one, 0™ belongs 
to 8^2- The matrices 6'™ and 9m. px arc therefore equal, which concludes the 
proof in the non-isotropic case. 

Let us now turn to the isotropic case. Let 6 belong to 8"^°'+ and let m be a 
model in All. As previously, the matrix 6*™ satisfies < \\9\\i. Since the 

distribution of X is invariant under the action of the group G, 6*™ belongs to 
8;™. Since ||6''"l|i < 116*111, 61™ lies in 8+'.2°- It follows that 6*™ = Of^^^. □ 

Proof of Corollary 4-3 in [0]. Let be a matrix in 8+ such that (IHI2) holds 
and let to be a model in Mi. We decompose 7(0m,pi) using the conditional 
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expectation of X[o,o] given X 



Eg 



-| 2 

X[o,o] - Ee (X[o,o] |X,„) 



Eg (X[0,0] - ^ ^,n.pi[»,il^[ij] 

{i,j)em 



By Corollary (11) in [(>], we know that 



Ee (X[0,0] \X,n ) = ^ e^,p, [L3]X[Lj] 
{i,j)em 



Combining these two last identities yields 



(ij)eA\{(o,o)} 

Subtracting 7(6*). we obtain the first result. The proof is analogous in the 
isotropic case. □ 



References 

[1] BiLLlNGSLEY, P. (1995). Probability and measure, Third ed. Wiley Series in 
Probability and Mathematical Statistics. John Wiley & Sons Inc., New York. 
A Wiley-Interscience Publication. MRMR1324786 (95k:60001) 

[2] BiRGE, L. (2005). A new lower bound for multiple hypothesis testing. IEEE 
Trans. Inform. Theory 51, 4, 1611-1615. MRMR2241522 (2007b:62024) 

[3] BOUCHERON, S., BOUSQUET, O., LUGOSI, G., AND MASSART, P. (2005). 

Moment inequalities for functions of independent random variables. Ann. 
Probab. 33, 2, 514-560. MRMR2123200 (2006a:60024) 

[4] Massart, p. (2007). Concentration inequalities and model selection. Lec- 
ture Notes in Mathematics, Vol. 1896. Springer, Berlin. MRMR2319879 

[5] MORAN, P. A. p. (1973). A Gaussian Markovian process on a square lattice. 
J. Appl. Probability 10, 54-62. MRMR0353437 (50 #5920) 

[6] Verzelen, N. (2009). Adaptive estimation of stationary Gaussian Markov 
random fields. Tech. Rep. RR-6797, INRIA. arXiv:0901.2212v2. 

[7] Yu, B. (1997). Assouad, Fano, and Le Cam. In Festschrift for Lucien Le 
Cam. Springer, New York, 423-435. MRMR1462963 (99c:62137) 



